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PREFACE 



This ini nual is designed to accompiny school reports for a dis^Jdct. Thej-e is an 
interpretation manual for each of the three le\els of schools assessed: elemehiary, intermediate 
and secondary. The manuys are not intended to stand alone: thty are aids to school administrators 
and other staff members for understanding the reports of their respective schoois. 

Two other EQA publications complement the information contained in this manual: 

1. The First Six Years gives a more general backg: of assessn^ant in 
Pennsylvania-what it is and is not and additional informiT: ? . • EQA's evolution. 

2. Get tins Inside the EQA Inventory delves more dee^. y i to the rationale, 
develoi.ment ard .haracteristics (reliability, validity, factor analyses) of the 
instruments (rest, end questionnaires) used to measure the Ten Go^s of Quality 
Education, 

With these three publications and a school report in hijid, tlie reader should have all 
the .lecessary tools to understand and interpret a school report. (A sample, but real, school report 
with marginal notations is replicate.? on the color pages of this manual.) Together, they enable 
one to become thorcu- hly acq>'.-a.ited with the 10 goals, how ihey are measured and reported 
for each school, what ihe cordition variables are, and whai stares on these variables mean. 

Once the imerpreti-r becomes familiar with these documents and has the task of 
explaining an EQA school rtpo'^f to another audience, an additional document-EQA : Publicity 

ITuggesiions-maiy prove 'isefi;!. 



i 



BACKGROUND 



Educational Quality Assessment operates under a 1963 legislative mandate (Act 299) 
that requimd the State Board of Educatioi. iv. 

...develop or cause to be developed an evaluation 
procedure designed to measure objectively the 
adequacy and efficiency of the educational programs 
offered by the public schools of the 
Commonwealth.... The evaluation procedure shall be 
so constructed and developed as to provide each 
school district with relevant comparative data to 
enable directors and administrators to more readily 
appraise the educational performance and to 
effectuate without delay the strengthening of the 
district's educational program.... 

Altliough EQA has been operational in 300 of the Commonwealth's 505 school districts 
from 1970 to 1973, it begins a new mode of operation with the 1974 assessment of schools. 
The changes are of three types; 

1. No longer does the program function on a voluntary basis. For the Hrst three 
school years, because of limited resources, participation was on a first-come, 
first-served basis. At its November 1973 meeting, the State, Board of Education 
established a timetable to enforce the mandate statev.ide.. Its u.nanimously adopted 
resolution states: 

During the school years 1973-74. 1974-75 and 
1975-76, the Departmen of Education will use the 
Educational Quality Assessment pi'oiedure to 
evaluate the effectivones > of the educatiosval programs 
for all Commonwealth school districts based upon the 
Ten Goals of Quality FHdu^atjon adopted by the Stale 
Board of Education. Public schools housing 
approximately one-third ef the students enrolled in 
each of the three grades 5. 8 and 1 1 will be inclu Jed 
in the assessment each year. 

The aiove resolution points up the second change: the additic n of grade to 
the assessmeit previously available for grades 5 and 11. Moreove r, he three-yeir 
cycle will involve, three years hence, 8th graders and 1 1th giadtrs previously tested 
at grades 5 and 8 respectively. 

New assessment instruments have l>een developed as a rv'sult of 0 ree yeais of 
experience at grades 5 and 11. A 1973 assessm;;nt of grade 7 (in sekcted middle 
schools) and of grade 9 (in junior high schools) provided the basis for the cunent 
grade 8 package used in intermediate schools. 
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PARTICIPATING SCHOOLS 



The voluntary feature of participation was not completely eliminated in March 1974 
In September 1973, Secretary Pittenger notified all superintendents of the availability of assessment 
for the 1973-74 school year and cited ine pending State Board action to mandate participation 
by one-third of the districts each year. 

The basis for selectinp applications from those solicited was to obtain a previously 
designed representative sample of the state's school districts. The criteria for repnssentativeness 
were number of studens in the district and wealth as determined by the aid ratio. Further 
consideration w given to achieving geographic balance and accommodating districts whose 
applications hiw ;en rejected in previous years. 

After some last-minute cJhanges and substitutions, applications from 170 districts were 
accepted. The districts contained: 

No. Schools No. Students ' 



Grade 


5 


785 


51,342 


Grade 


8 


240 


53,326 


Grade 


11 


191 


48,276 


Total 




1,216 


152,944 



From these 170 districts, a normative sample of schools was chosen. The emphasis here 
is on schools, since they are the unit of analysis. A report is compiled for a school-noi a student, 
not a classroom, not a district. 

The roUowing were selected as norm schools: 

No Schools No. Students No. Teachers 

Grade 5 354 25,209 5,489 

Grade 8 236 51,685 8.553 

Grade 11 189 47.043 9,273 

The selection of norm schools was geared to eliminate bias by (1) excluding 
unrepresentative schools such as college laboratory schools and (2) ehminating oversampHng of 
schools within any one district. 
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ADMINISTRATION PROCEDURES 



The superintiindeni of each participating district, when returning the initial application, 
appointed three representatives to coordinate EQA activities at the three grade levels. These 
representatives later attended one of 1 1 regional workshops, where their duties and responsibilities 
were explained. At these February meetings the School Represeniaiive's Handbook and Monitor's 
Handbook, designed to standardize administration procedures, were discussed. In addition, the 
representatives were briefed on the background of EQA and, by viewing a sample school report, 
learned what they could exp**ct in return for their efforts. 

This cooperation and acceptance of responability for administering the questionnaires 
is essential to the success of the assesj,meni program. EQA staff members visited a number of 
schools during March lo obsene testing conditions and to discuss problems with the representatives 
and their proctors. Suggestions for changes and improvements in the various handbooks were 
solicited so that reactions of those most closely involved would be incorporated in future 
publications. 

The administration of tiie questionnaires took about four hours of student time. In 
most cases this was spread over four days, sometimes only two days. Except for the two basic 
skills tests, the sections of the questionnaire have no rime limits for completion. The Monitor's 
Handbook lists time ranges ^het might be expected for each section but with the direction: 
Students should be given amph time to finish each section. 

The students initially place their names on the separate, machine-scorable answer sheets 
so that they can retain their own answer sheets during succeeding s«";ssions. Upon completion 
of the finul session, they remove the name portion of their perforated answer sheets to assure 
confidentiality and anonymity of responses. 

Another role of the district representatives is to administer and collect teacher 
questionnaires (sec Appendix A) to gain additional information Lbout the school from the teachers' 
perspective, as well as information about the teachers. Teaclu rs likewise respond anonymously, 
placing only the district name and .school name on the qu.;stionnaire. All teachers fill out 
questionnaires; no sampling procedures are used 

The envelope containing the completed teacher questionnaires and the completed 
student answer sheets is mailed for scanning, scoring, compilation and analysis. 
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NATURE OF THE QUESTIONNAIRES 



The Pcntisylvania Student Questionnaires measure, by aggregating student scores, a 
school's status on the Ten Goals of Quality Education. 

PENNSYLVANIA'S TEN GOALS OF QUALITY EDUCATION 
Quality education should; ^ 

I Help every child acquire the greatest possible understanding of himself or herself 
and appreciation of his or her worthiness as a member of society. 

II Help every child acquire understanding and appreciation of persons belonging to 
other social, cultural and ethnic groups. 

III K».'iii every child acquire, to the fullest possible extent, mastery of the basic skills 
in the use of words and numbers. 

IV Help every child acquire a positive attitude toward the learning process. 

V Help every ch'^d acquire the habits and attitudes associated with . ^sponsible 
citizenship. 

VI Help every child acquire good health habits and an understanding of the conditions 
necessary for maintaining of physical and emotional well-being. 

VU Give every child oppoitu,<iity and enc luragement to be creative in one or more 
fields of endeavor. 

IX Help every child to understand and apprecbte as much as possible of human 
achievement in the nauiral sciences, the social sciences and the humanities and 
the arts. 

X Help every ch*ld to prepare for a world of rapid change and unforeseeable demands 
in wliich cuntmuing education tliroughout adult life should be a normal expectation. 

These comprehensive A^nis, adopted in 1%5, were reatTirmed by the State Board of 
ducation in January 1974 

Each «>oal statement, si3ied above in its entirety, is given a name for brevity's sake. 
For example, in the school report (ioal V is referred to as Citizenship. But citizenship means 
different things lo different people. Thus, to interpret what a hcIiooJ's Goal V score means, one 
needs to know the underlying rationale of tht^ ciii7enship instrument and what areas are covered. 

Table I. contains a summary of the instruments with names for the areas covered for 
eacn goal, a description of the subscales, the number of items and a simple item for each subscalc. 

For the cognitive measures, the ihv'orciical maximum score for .a student i* equal 5o 
the number of items for that goal and the thcoreiical minimum is 7,ero. Thca^fore, for the basic 
skills measures, both cognitive, the theoretical score range is O-.'^O. 
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For attitudinnl measuivs, nisponr.es are not considered rij^t or wrong but are viewed 
as falling ;Uong a continuum with a preferred direction given. For Goal I, responding very true 
of me is considered the most preferred response to a positive item and is given a weighted score 
of 3. Weights of 2, 1 and 0 are ai.signed i& the other three responses. If a student gave the 
most preferred response to all 40 items, his or her scoa* would be 120 (40 x weight of 3 for 
most preferred responso tc each itern). In general the theoretical minimum for a student is zero 
and the theoretical maximum is x iK-1). N is the numi^er of items and K is the number 
of response choices. ' . 

The interdtpundiince ;jrni^vg the goal areas is illuslraleil by the crrrelation matrix in 
Table 2. For example, ihe corretalion of 0.10 between Goal I and Goal IIl-M indicates that 
in schools where the self-esteem scores are higher, the math scores f^kewise tend to be high. 
This is not to say that a higher self-esteem will cause a .student tl do belter in math, or 
vice-versa. Cause-effect conclusions from correlation information are untenable. Also apparent are 
the high correlations among the cognitive measures-Goals lll-\ . 111-M and VIII-K. 

A more detailed* discussion of the development and the rationale for each measuring 
ipstrument can be found in Getting Inside the EQA Jnremnrv. This publ'cation includes reliabihty 
and validity information and shows the relationships among fiie si^iscales <. r a goal to all other 
'iubscales in tl\e qi estionnaires. 
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TAaE2 



COREEI.ATiON COEFFICIENTS 
AMONG SCHOOL GOAL SCORES 
GRADE 11, Ifel89 





I 


II 


III-V 


III-M 


IV 


V 


VI 


VII 


VIII-A VIII-K IX 


I 




















11 


38 


















III-V 


23 


31 
















III-M 


10 


28 


90 














IV 


42 


15 


17 


12 












V 


05 


47 


18 


28 


27 










VI 


13 


32 


-15 


-11 


22 


64 








VII 


43 


08 


-04 


-13 


25 


-11 


-12 






VIII-A 


39 


36 


27 


26 


33 


58 


50 


-08 




VIII-K 


13 


25 


91 


88 


10 


28 


-05 


-13 


32 


IX 


40 


55 


40 


40 


38 


59 


43 


04 


62 42 


X 


45 


34 


-18 


-19 


24 


35 


66 


05 


45 -19 39 



NOTE: All porrelation coefficients have been rounded to two decimal places and the 
leading decimal points hare been omitted. 

|rl_: 0.14 is significant at the .05 level 
iri > 0.19 is significant at the .01 level 
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PERCENTILE RANK BY GOAL 



Of the four kinds of infonnation in a school report, perhaps the most attention is 
given to the schools percentile rank in the state. 



The rank on each goal is determined by comparing the school score to the scores of 
a representative group of 354 normative schools. 

Table 3 graphically represents the normative method of scoring by showing, at 
five-percentile intervals, how the raw score averages for a school translate to percentiles. For 
example, Upper Penn Elementary School's score of 78 J 6 on Goal I places the school at the 
60th percentile, which means that 60 per cent of the schools statewide had lower school scores 
on this goal. 

The reader may note ^e small score difference between a 60th percentile score and 
65th percentile score. This occurs because of the limited range of school means. In a given school 
student scores on, say. Goal Ill-M may range from 2 to 28, whereas the school mean, or average, 
score might be 15.31. This is true in each school, as iUustrated by the frequency distribution 
below- 
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gure 1: Comparative Distributions of Student Scores 
and School Scores on Goal !:I-M, Grado 8 
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The range of student scores in the state is from 2 to 30, but school scores (means of student 
scores in each school) arc concentrated between 12 and 18. Therefore, raising a scho 1 score 
from 15 to 16 means 'bypassing possibly 30 per cent of the schools in the state. 
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PREDICTED S ORE RANGE 



One objection frequently raised to norniative scoring methodology, as illustrated by 
percentile rank in the state, is that it falls to incorporate the widely divergent operating conditions 
of various schools. In a state as large and heterogeneous as Pennsylvania, one can easily think 
of thc*vastly different resourccs-physic^il facilities, financial resources, teachers and, possibly most 
importantly, the home conditions whiCh influeitce the students entering a school-under which 
schools operate. The Commonwealth t vmtiins such disparate school communities as rural-farming 
areas, coal-mining arei*s, big cities, small ^owns, affluent suburbs, working-class suburbs to name 
a few. 

These diversified conditions place limitations-some deterministic in nature, others 
amenable to change-upon what a school can expect in the way of student performance. In physics, 
one talks about efficiency in terms of output relative to input. Similariy for schools, output 
(student performance) can be viewed relative to input (school conditions). 

The Pennsylvania assessment model does just this. Data are collected on school conditions 
(see following section on CONDITION VARIABLES) which, educators and researchers contend, 
place restraints on what a school can accomplish with its pupils. 

Correlation coefficients are then computed between these quantified school conditions 
and tlie goal scores for the schools (see Table 9). Some of the hypothesized relationships hold 
up, others do not. From this set of potential predictors, those school conditions which statewide 
relate mos highly to a given goal can be used to calculate (predict) a score range for a school. 

The predicted score range does not involve a value judgment about the school. It is 
based upon the knowledge that other schools in the state, when operating under a similar set 
of conditions, tend to score in this range. 

This methodology allows one to make a second comparison of the school scores: Are 
we within our prediction band, above in any goal areas, or below in any areas? Another way 
of viewing this question is: In Goal Y how are we doing compared to schools operating under 
a similar set of conditions, or schools with resources similar to ours? 
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CONDITJON VARIABLES 

Ratioiiale 

The previous section, Predicted Score Range, stated that to ameliorate the possibly 
invidious comparisons that percentile ranks alone invite, the Pennsylvania assessment model also 
includes an input-output component. 

Schools around tlie state have vastly diifering resources at their disposal The differences 
are not only In tlie students served but also in teaching staff and financial and parental support. 

Measurement 

Tables 4 and 5 describe the 35 variabl s which were collected to identify the differences 
in resources among ele^ieniary schools. The variables came primarily from students (as part of 
their questionnaires) ai^ teachers (Appendix A-Teacher Questionnaire). 

It is extremely important to note how the variable was measured and quantified. High 
scores for a school on these variables arc not necessarily good. The numbers attached to these 
variables are designed to reflect the presence or absence of the characteristic in question (e.g., 
per cent female teachers) or to differentiate by quantitlcation one class within the characteristic 
from another (e.g., teacher locale where highest weights are assigned to outsiders). 

Percentile Rank 

For each of the 35 condition variables the school receives its percentile rank compared 
to the state normative sample of 189 schools. This information is provided so that one can tell 
not only H7;a/ conditions or resources a school has but also its relative conditions. A liigh percentile 
likewise does not necessarily imply good conditions. 

The norms charts (Tables 6 and 7) for the two groupings of variables give a more 
graphic representation of the percentile rank scores in the school report. They illustrate also how 
much schools differ on a particular variable. Because they are distributions of school means, the 
ranges of values at times can be very narrow, so that a small increase in a ixhool mean value 
may translate into a large percentile rank change, e.g., stable (stabiUty of student residence). 

Statewide Item Results 

in the school report the condition variables are stated as a school score. In most cases, 
inteipreting a school score is simple and straightforward. For instance, to say that the average 
class size is 27.9 seems understan lable enough. But many variables are scaled in such a way 
that the mean score, which becomes the school score, disguises much of the information used 
in its calculation. 

As a result, percentage replies by item are included in the school report for some variables 
obtained from the student^ and teachers. Although the percentages for a particular school are 
by themselves meaningful, an additional comparison of these percentages to the statewide figures 
might amplify the picture for the interpreter. Table 8 includes the statewide percentages of those 
variables for which item data are included on pages 4-7 of the school report. 
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Correlation Matrices 



Table 9 shows the relationship Ixnween a given condition variable and school scores 
on the 10 goals. Here ayain the rpader is warned against constructing a cause-effect relationship 
from a correlation. 

Table 10, which shows the in tercorrelation among the condition variables themselves, 
although open to the same warning as above, suggests one of the reasons why cause-effect 
relationships aa» so dangerous. No variable exists in isolation; many interrelationships exist. The 
staff-pupil ratio, if changed, would alter the instructional expense per pupil and may change any 
number of teacher variables (experience, perception of learning atmosphere, classroom practices, 
etc.). 
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BEST copy mmii 

FI^ON ^DMD^ISTRATORS. DSPARTMCNT RECORDS AHD tlACHCRS 



VARIABLE AND 
COMPUtER CODE 


MEASURE 


WHGHtlNG 


INDEX DESCRIPTION 


1 CREHROLU 


Thv tdiooi ddmiTiiitroior 
rtporltd «mi>ilm«Df ol th« girod* 


Acia^) number of students in the 
por^'Cipot'ng grode« 


A higher volue Indioies o iorg^ 
tfrode enrol lment« 


pctatten 


The ichoo) odmmi»t'a*or 

f W' IVW W'' W% 1 S*» ' %i ™ *f 

grod* und«r ron^idttrolitjn^ ) 


Eicpresse<j nearest tenth oir o 

per cettt« 


A higher volue Indi Cotes o higher 
ottendonce rote^ 


iNSEXADM 
ovtr^Dii doHy membership) 


The rnilructtoinol e]i|>«n««i ol 
ih» 4#cor»d«ry pfogrom 
divided by the Average Doi)y 
Mery*ber»h)p ol ihe t^lemenYoty 


^v<p *^>***l In nearest >(rhole 

dolta«- for 1972.73, 


A higher value indicates thot the 
district expentls r^^lotively more 
luntss p^^^ student tor lecondcry 
instructs ^n» 


TLOCALE 


The leocheri r»port«d wh«»« fhvy 
fpent ir ^it ol thei* hve»*. 


2 ^ More ihon 100 miles from 
bdu^daries ol this ichoo) 
di >^rt ti 

1 ^ Mor« tt)0n 30 mUes but less 

thon 100 mi les 
0 - In or wilhin 33 miles 


A higher value indutjf^i ihei \hm 
School leaching siqfl ^ drawn 
from more distont on r i« 


TSATPAR 
TSATF5 
t SAT St 
n«ocH«r »a1»i*^^Clion wifh 

1 ) Por m * 
1) Stall 
3) Si\)d*nii 


1 — 

The leoifh^ft repotted how sol it- 
lied they were with their 
retoiionihip With> 

Parent* ond parent gi-oup* 
Fellow iioH memberi 
Studenii 


^ y ery ^oii •ii oo 

2= Some^rhot satisfied 
1 ^ ^cTiewhot dissatisfied 
0 ^ Voiy dissotislred 


^ iiiuiiVF vo>Uv ori Qny \i»mmw 

ir^d'icrei indicates that the 
teaching staff of the school is 
more lotisfied with its relation* 
ships With the groups 


TCLATT 
{Atiitud« to wort' 


The teacher* r*pcr^w^ )f they 
enidy cla^&YOom teochtng. 


4 ^ Almost olwoyi true 

3 ^ Usuolly true 

2 " Sometimes true 

1 * " tidom true 

0 - Almoin nevei true 


A higher volue indicates thot 
teaching stoH more often enjoy 
clossroom teaching. 


PERSAD 
lT*Qch«r pttrc«pt)&n 


The teorhers responded to 6 
«tw» t:on«ernrng theu fee^mgs 
oboui the sthoof odmtnimirOfion 


4 * A|woy> true 
3 ^ U tuolly true 
2 ^ Sometimes true 
1 ' Seldom true 
0 - Never true 

Range: 0*24 


A higher value on this )nde» 
indicates a more potitive 
ottitude olf the schooTs teochtnn 
St off towo*"< the school 
admmistro.ion* 


PERDAD 
dillrici admvi^' if'ohon) 


The teacher! reiponded to 3 
^tBm» concerning then leehngi 
about the dist^ct odmintft^roiion. 


4 - Alv/ays t/ue 
3 - Usually tru« 
2 ^ Sometimes true 
1 = Seldom true 
0 ~ Never true 

Range: 0*12 


A higher volu* on this tnd«x 
indicates o more positive 
ottitude o^ the ichooTs teaching 
staff t*5word* the district 
0 dm ^n IS trot torn 


CLPRACT 
(Cloiiroom procttctt) 


The teachers reported the oirtent 
to which ihey uied 11 clostroom 
practrcet judged to be rnnovot>ve 
feiigi^ pupil port) CI pot 1 on in 
lesson plonntng). 


3 - 1 use It doily 

2 ^ 1 wfte It weekly 

1 ^ 1 use It monthly 
0 1 do not ijse ti 

Range: 0^33 


A higher volgs indicates the 
teoching stoff report mote lre» 
quent usage of theie proctic^s. 


PERLERAT 
itT«ocK»r p«rcrpiion of 
looming otmo tph^r*) 


The teachers indicated whether 
each of V3 school problems con^' 
stituted 0 probl«n m their 

sc hoou 


) = No 
0 :i Yet 

Ronget 0-13 


A higher value mdi Cotes a 

positive leommg otmosphere^ 
that teochers feel fewer of the 
hsied problems affect their 
school* 
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TABUE 4 (Conunued) 

PROM ADMINtSTRATORS. OEPAItTME»»T RECO^Dj, AND TIACHE^^S (Conttnu^d) 



VAR*A&LE AND 
COMPUTER CODE 


MEASURE 


5^rElGHT1NG 




mO|i( DESCRIPTION 


TPEftPAR 
(T»otBh«r p«r caption 
of ^r«i>ti) 


Tho t#oeh»rft >nilicol«d wh^thiif ' 
•ccCi of 5 eonditioiift rolofod to 
porontol attitudo conttttutod o 
problem \n fhoir ichooU 


1 2^ No 
0 Yo» 

Rongo: 0-5 


A highor voluo mdiieotoft c 
poftitivo ottitudo On tho po^t of 
^ho toii^or ^oword the porv'^ti j 
ond homOi 


TPEP 


Tlia toochttm ro»pond»d to 6 
ilMi f#9ordiii9 yHoif fooltn9« 
obeuf fhoir ft«]f Ofti4jrodnofti« 


Almcftt olwoyft truo of mm 
Ofltn truo of mo 
Somotlmoft truo of no 
Soldom truo of mo 
Almoit novor truo of mo 

Ron go: 0*32 


A Itigho^ volu« indicQiok thot - 
tho t«och«r« oro rolotivoiy mo?o j 
ftolf^Oftfturod. 


PCTF!iM 
(Ptr t;»n! 


Tbo toochiOf B indrcotttd thoir 


Exproftftod in por^ . itago. 


A HgHor volu* md^cisitov thot 

thr ichool hoft o higtior 

pok. ontogoof fomolo t«ochort« , 


TEDUC 
{Ti»ocK«r •^Kicotion) 


Th» toocKvr t mdlicotod th« Uvol 
of lormol •dyeotton th«^ havo 
ottotn«d» 


4 - Doctof *ft d«gro« 

3 s Mofttor'ft dogroo pluft ^ y*or 

2 ^ Mofttor^i dogro« or 

oquivolortcy 
1 ^ ooctioJor ft Qogrot 
0 = No dogroo 


A ^lighor vtiluo ind^cmot thot 
tho ftchoorft infttrycttonol mtoff 
f»j>ortod 0 high or lovol of fo^mol ; 
oiivicotiom 


STAFFP 
(T«och«r to 

pupil rotio) 


Yh* !ootK«i^ft r«porf«d t^«tr 
ovOtago tloftft tixo occluding 
iuporvi ftt}ry dutioi ftuch o« 
ftfudy holK 


Eicprsftfttd Oft 0 toochor to 

pupii rotiok 


Tho 1^ iontil* rank indicotoft 
tho poi* :«nt of ftcKooli with o 
groottf ov«rog« clomft liio^ 


HRPERWK 
iT*och#r houM of 
in ft vet IDA por w^ook) 


THo t*och*^« ropoitod fh« numbor 
of clock houti th#y oro oiftignvd 
to cloftftroom mfttrgctton por w»«k* 


E)vproftftod OS ovilrogo hogri 
por wook> 


A highof volu9 indtcotot thqt 
tho tood^ort of tho tchool ftpond; 
rolotivoiy moro hoMr» in tho 
cloftftroom* 


tlXPER 
iToochor oxponwics) 


Tho toach«ri foportod tbo tofol 
yoorft of i#rv)C« tn ftducotion 

tncludtfiQ curr^t tchodl v#af>. 


Expromod oi ovorogo yoari* 
o«porionGO> 


A highor voluo itidieoton thol 
tho toochofft of tho ftchool hovo i 
^•^otivoly mOfo yoorft of toochiitj 
^^o>iipon\fnco. 


PREPERDY^ 
(Nwmb»f of »#«hoT 
propofotiOfiB por doy) 


Tho tvo^ff ft reportod tho 
nvmb«r of difforent coiiTftOft, on 
tK« ovoroi; »^ fhoy t»och por doy« 


Eicproftftod Oft ovorogo numbor 
of proporotionft por doy. 


A highor voluo indicotot thof 
tho toochorft hovo rolotively mof! 
proporotionft por doy. 
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fnom STUDENTS 



VARIABLE AND 
COMPi»TH« CODE 


MEASURE 




INDEX DESCRIPTION 


FOCC 
(FoiK»r** occupiitton) 


potion rnotl 1ik# ti.eif <a3tSBrft or 
moU Quordicr* found on o U^i of 

poftiiib)<f occupot*on> ond 6 
lp«Clt>* co)«oort«»^ 


Th« ftcnupationol cat^gort^ft witr« 
weighted frttm ^ t& 96 dccordin0 
to o conbi ^otii>n of edwcot^oo 
)i(}*d«d »tcure the occupoti 
DT.J fnCa*^i« ddiivtd from ih« . 


A highet vo)u# ind^ftatei iKot 
the school tends *o drow o liargv 
pn^nortion of itA ^Yudcnis f>om 
hom^s wh«re ih« foiKers oro 
•mployod in hi giher«>paying 
requvrin^ o higher edvcationot 
leveL 


OCDESIRE^ 

i 


ftom th« fifti of 145 occiipoi»on» 
m9nt^on«d obov*, tho Biyd«nt» 
tmpr^rmd ihf^ occvipotiOns moti 
UUm thoi* thoy wi»h lo fellow 
wh«n fintih#d m ftChool> 


Somr w?*yih!mfj u»«d \n FOCC 


A higher volge indjcctos (hot 
th# ^itdenfs d*»u« tc ottam 

hig)>ipir poying |obs reT^uifutg o 
higher educotionol love}. 


OCE^f>ECT' 
(Occupationol #Ap»ctat)on) 

i 


^rom \Hm ii ti of 145 occupviiont 
ih« irvdanK r«porl«d fh« occv* 
poiiont most tike iho»e ih«y 
rvolly •jcptcrt to follow whun 
flnt»h«d tn ftChool. 


Sam* wvipKiing ui«d m FOCC 
obovo 


A highis-* value (ndicatas thot 
the studentft exp<»ct tu attain 
highe; poytng lobs lequinng 
0 high*^ educpt\onol leveK 


PCTGiPLi 


j 

Th* ifud^nti indicoftd iheir 


Eicprvitfrd 'n p«rctntoge^ 


A highet volwe indtcatei thot 
the school hon o greoter piopor^ 
t)on of girU tn tho grode I#v<iK 


MEDUC 
(Molh«r^ft •<iucorion) 

1 


Th* »iud»ntt r«por»*d th»hio^'«»' 
iev«l of formol tduColton oltotntd 
by >h*ir mofhtri or femoU 
guordionfcv 

; 
1 

! 

\ 


B ^ Ph,0* Of prof«tft)onol d«gr«* 

7 - Som» work lowqrd Ph.O, or 

profe«irono) d«grc€ 
6 =^ Mo»irrS d«gr«o 
5 ^ Boch»lor* t dtgroo 
4 " Soft© coMeg», voco^ionoi, 

TffcHnicol, bu»in«»» »chool 

aUmr h\ gh »choo) 
3 - High school groduov© 
2 " 5>omo high school, but not 

0 groduOt« 
1 Gompl»i»d grode icKool 
0 - Nono or »omo grod^ tchool 


A higher value indicator thot 
the school drows studorjt* from 
homos »n vvhich the mothart hove 
Ottoined o higher ovW'ogt' level 
of fotmo) oducotioo 

1 


RESIDE 
{Typ« of community) 

1 

i 

j 


Thm ttud«ni» with th« o»d ihf 
) monitor rvporttd t\%m type of 
1 communtiit* 'n which th»y w«r« 

th«n Itving. 

1 


7 ' In Ph«todo)ph>o or Pittsburgh 

6 ^ ln*.d* 0 ioige city (^00,000 

to 500,000 poop(«V 
5 ' lnsid« 0 m«dium %if City 

no.ooo to 100,000) 

4 '^^ in 0 Suburb of Philodelphto 
j r>r Pittsburgh 
I 3 In o fcuburb of o lorgo City 

7 > in a suburb of o medium 

sue C>ty 
1 - in 0 smoll town Hess rhon 

10,000 pffopi*) 
^ •■ in inw pppn cou'>>'y in q 

forming community 


A highei voluo indic««te9^ thai I 
the ttudent^ ro?idtf «r "jt^jc^ 
oreo« dense ptipulo<» -n, t.e.^ 
more 'emcvad from op<^r- J^oce. 

1 


PCTWHITE 


Th« ttud#nr» r«pon«d Yh«ir 
roct 


Expressed m percentage, 


A higher volu* mdicotei* thai 
ihe tchonl ho» e gi<»nioi pfcpor* 
fiAn of white students im the 
grode levoh 


LIBRARY 
(AcciitBikiiiiy of iibrory) 


Th« ftlud«nlB reported how oft«n 
thvy wf obU to uft« th« ftchool 

1 » b*' ory . 


4 ^ As often 1 noed to 

3 ^ Frequently, but not os often 

Of 1 would hko to 
2- Only two or three doyt o 

week 

1 * nly when my closs i* 

Ch»dui*d for librory wprk 
0 - No librory tn school 


A highoi score mdicotes thot 
the sludffnts report qtmof f 
oc ces sib» l» ty of tl«o ^ib^ory. 
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TA8LE 5 (Continued) 

PROM STUDtNTS (Cominutd) 



VARIABLE AND 
COMPUTER CODE 


MEASURE 


WElGHtiNG 


IHOEX DESCRIPTION 


COUNSEL.^ 
1 Acc«itib«hty 


Th* Bfi><)«n*i r«pori#<i How ohmt% 
fh«y ytmrm ob)o lo lolk to tho 
li^hooi gykdonco eoyniftior oboMt 
Q concorn* 


4 - Wh«nov«r 1 nood »o 

3 Oftott^ but not 01 ftot)u«fitly 

OA 1 WOi^ld hk« lo 
2 • Or\\i i«*iOrt moking owl 0 

cios^ ichoduio 
1 7 Only in group yuidonoo igi»ion 
0 r Ho gu»donco toutiioioir 


* Ki^hti volu« mdlcoioft thot 
no tludonio ^Oport froor occott 

to iN guid^nco •I'ftff. 

- . w : 


STABLE 
IStobiHty of 


Th« ttu4#n; ropot1*d tho number 
o( iliHvront tcKool butldifigi 
ottttndod within tho pout 3 yvdrt 
bocayto family chongnd 


4 ^ My fomi ly hot noi moy#d 
withm tho potf 3yoori 

3^3 iehoi>1 buildings 
^ ^ 3 tehool but ldingi 
1 ^ 4 tthool building! 
0*5 school building* 


A htghor volyo mdicoiom thot 
tho i>udonti como from lomilioi 
>(k^;^lch oro loti mobilo. 


r ^ r\ m 1 1 

tDwa«d icHooi) 


Thw itvidvtitB ropott#d ihviv 
1 ))niOi« on thr«« it«ma~ 
\\) Mt por«ntt on^oy h«otr»n<g 

oboot ichool 
I7i My por*nti lovl tho school 

it doing 0 good job 
(3) My porwntt tuppoii whoi 
tho mchool 4om% 


3 * Almoil olwOi^i 

7 ^ Utuolly 

t ^ Somofimoi 

0 - AlmOmt novor 

GrodoB & 11 Rongo: 0*9 
Grodo 5 Ro i0O> 0«6 


A highor vol^o iidicotoi thot iho 
otytl^ntft foil ihoir poront« hovo 
0 groot ^ntorott vn tho school, o 
Kighor opir x^n of iht work of iKo 
ichool, ond groo^or lypport of 
tho ichool. 

* 


MORESB^ 

ikA^^M mm n — \ 


Th« Btudot^tm roport«d thoiv 
porc^tkon of tho iingl* b^itt way 
fot 0 boy to got lo b# import«it 
ond looked up to by oihor 
itudonH. 


6 ^ Boing btighi and wolUinfonn«d 
^ ^ Uoing won m •thool 
4 ^ Bomg a loodor In ichool 

OCl^VlliOft 

3 « Bomg lun lo b# with 
2 = Boing on othlolic itor or 
o ^oor loodor 

1 = Boing good»looking 

0 ^ Coming from tho right fomHy 


A highor icoro in<)i€ol«i ihot 
tludoni* porcoivo iniolloctyot 
fociort ot rolotivoly moro 

)mportont thon tociol fociorm or 
othlotici in dotormimng o boy^i 

popuiorliy* 


(Mor«B » Gifli) 


Tho »tud«ntt roporl*d tKoir 
porcvpllon of tho «>ngio boil way 
for 0 girl to got to bo imporlont 
ond looked up to by othor 
ttydontik 


Somo Of fo^ MORESB obovo. 


A highor icoro indicotot tho 
itudonii porc«iv« intolloctuol 
locio^t o* tolotivoly moro 
importont thon tocioi factors m 
dotermining o girr* populority. 


VALUES^ 
(P«rionol voiu«t) 


Tho ■^fdontm roportod tho 

quolity which woi moit Importon^ 
to thorn 01 indivtduolt r#go^dlot« 
w* wnm oinwfB inoy crHvOBOd 


Somo 01 for MORESB obovoX^ 


A htghor icoro indicotot thot 
ttudonift porcoivo inlolloctuol 
pur twit d ot hoving moro porsono) 
vglgo thon iociol tlotiit foctort^ 


HOMECUM 
(Hom« citmof*) 


Tho •ludonift ropon«d thoir 

opinioni on B itomi obout homo 
conditions^ 


Vory much I ko mo 
UiuoMy ltk« mo 
UigoUy uiliko mo 
Vofy much unliko mo 

Rongo^ 0-34 


A highor voluo indicotot ihot ihe 
tiuxiontt h^o moro fovoroblo 
Qftittidot toword iHoir homo 
conditioni. 
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Crod* 8 wd II Onty 

On\Y tK« first two itwnt wvr* vtm6 lor prod* ^• 
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TABLE 8 



STATEWIDE ITEM REPLIES FOR SELB:TED CONDITION VARIABLES 



TSATPAR, TSATFS, TSATST 
In your teaching situation, how satisfied are you with your relationship with: 



Parents and parent groups 
Fellow staff members 
Students 



Very 
Dissatisfied 

3% 
3% 



Somewhat Somewhat Very 
Dissatisfied Satisfied Satisfied 



17% 
11% 
11% 



49% 
41% 
48% 



26% 
44% 
38% 



I enjoy classroom teaching. 
Almost never true 
Seldom true 
Sometimes true 
Usually true 
Almost always true 



TCLArr 



0% 
i% 
7% 
43% 

49% 



CLPRAGT 





Not 
Used 


Each 
Month 


Each 
Week 


Each 
Day 


Pupil participation in lesson planning 


38% 


26% 


20%* 


15% 


Pupil participation in classroom teaching 


19% 


28% 


23% 


29% 


Having pupils work in small learning teams 


15% 


33% 


32% 


19% 


Role playing (acting out situations) 


52% 


29% 


13% 


5% 


Use of games to aid learning 


34% 


40% 


19% 


6% 


Pupil evaluation of classroom climate 


38% 


40% 


U% 


8% 
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{Continued) 

CLPMGT (Gontinued) 





Not 


Each 


Each 


Each 




Used 


Month 


Week 


Day 


rupii particJLpHtion m doveioping classrooin rules 


52% 




12$ 


9$ 


Involving pupils in coimminity projects 


57% 


30$ 


7$ 


4$ 


Utilizing local citizens as resource personnel 


>2% 


40$ 


5$ 


2$ 


i\ipils as helpers or tutors of other pupils 


1S% 


28$ 


28$ 


26$ 


Joint lesson planninn with one or more teachers 


53$ 


26$ 


15$ 


7$ 



PERLERAT 

Survey of school problems: (per cent = yes responses) 

There is too nnich teacher turnover 12$ 

The classes are too large for effective teaching 5355 

The different races or ethnic groups don't get along together 10$ 

There are too many interruptions during class periods 4.35^ 

Teachers have too little freedom in such matters as textbook 

selection and curriculum 28$ 

There is too much competition for grades 30% 

There is too much emphasis on athletics ^3^ 

There should be a better mixture j the students are all too 

much of one type 24.$ 

Too much time has to be spent on discipline 27$ 

The students aren't really interested in learning 61$ 

There is a lack of effective leadership from the school administration 46$ 

The teachers don't seem to be able to work well together 18$ 

We have poor instructional equipment: supplies, books, laboratory 

equipment, etc. 21$ 
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(Continued) 
TPERPAR 

(Per cent = yes responses) 

There are too many absences among students 66$ ! 

Pupils are not well fed and/or well clothed 10$ ] 

Parents attempt to interfere with the school 22% 

The parents put too much pressure on the students for good grades 29$' 

The parents don't take enough interest in their childr en's schoolwor]^ 66$ 

RESIDE 

i In what type of community are you now living? 

In the open country or in ^ farming community 19$; 

In a small town (less than 10,000 poeple) that is not a suburb 24$ | 

Inside a medium size city (10,000 to 100,000 people) 20$ i 

Inside a large city (100,000 to $00,000 people) 1$^ 

In Philadelphia or Pittsburgh 2$ 

In a suburb of ci radium size city 13$' 

In a suburb of a large city 3$^ 

In a suburb of Philadelphia or Pittsburgh 18$- 



PGTWKTE 
describes you? 
5$ 
93$ 
1$ 
0$ 
0$ 
1$ 
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Which of the following best 
Black 
White 

American Indian 
Oriental 
Puerto Rican 
Other 



(Continued) 
LIBRARY 

How often are you able to use the school libraiy? 
A3 often as I need to 

Frequently, but not as often as I would like to 11^ 
Only two or three days a week 10^ 
Only when my class is scheduled for library work 11% 
There is no library in this school 1% 

COUNSEL 

How often are you able to talk with your guidance counselor about a concern? 

Whenever 1 need to 7356 

Often, but not as frequently as I would like to 13JK 

Only when making out a class schedule W% 

Only during^ a group guidance session 2% 

This school does not have a guidance counselor \% 

STABLE 

How many different school buildings have you attended within the past three 
years because your family changed residence? 

My family has not moved within the past three years 87% 

2 school buildings 9% 

3 school buildings 2% 

4 school buildings \% 

5 or more school buildings \% 



ERLC 



(Continued) 
MORESB-MORESG— VALUES 

MORSSB/MORESG: Aaiong the qualities listed below, what is the single best way 

for a boy/girl to get to be important and looked up to by 
other students in this school? 

VALUES: Among the qualities listed below, what do you feel is most 

important to you personally, regardless of what others may 
choose? 





MOfiESB 


MUruibu 


rr AT TT1PC 
VALUlSib 


Being bright as well informed 


6^ 


3% 


^ 15% 


Doing well in school 


i% 


3% 


11% 


Being a leader in school activities 


11% 


U% 


A% 


Being fun to be with 


36% 


'35% 


56% 


Being an athletic star or cheerleader 


28% 


B% 


3% 


Being good-looking or attractive 


6% 


32% 


3% 


Coming from the right farxly 


3% 


3% 


2% 
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TABLE 9 



PlTHOOL CONDITION VARIABLE SCORES AND SCHOOL GOAL SCORES 
GRADE 11, N=189 



ERIC 







1 n 


Ill-V 


Ill-M 


IV 

^ w 


V 


VI 


VII 




VTTT-X 

VX4.4I— XV 




A 


aitKNhuLL 


1 




a* 


i5 


20 


-19 


-21 


19 




17 






ICTATTEN 


2 




AO 


50 




32 




-38 


19 


48 


21 


-17 


USBXAIM 


3 




22 , 


19 


24 




-15 






M) 






UOCALE 






20 ' 


26 


51 


29 








20 




-16 


TSATI'nR 






58 


59 


25 


25 






26 , 


57 


27 





TGLATT 
rKHrAD 

xm 

TEQUC 



7 
8 

10 
i I 
12 



# 

U 

20 



3'. 



^1 



36 


38 


32 






20 


34 


19 


36 


32 


27 








33 


17 


17 


16 


40 


22 




U 


19 




14 




24 
34 


22 


IB 




U 




30 


40 




25 






^2 


15 


24 


28 


21 


16 






30 




no 




35 




37 









32 



24. 



32 



23 

34 



24 



"rmv 


17 


























IS 




-22 


-16 












-17 






TKXiEit 


10 












15 








35 


14 


FREPEiilV/ 


20 


-20 








32 


21 


-19 


21 




17 




FOrc 


n 

A. a 


36 


2H 77 


68 


25 




-30 


23 


15 


ej 




-:(> 


OCliESIRE 




50 


26 , 56 


41 


27 


-IS 


-25 


36 




u 


25 




OCODPECT 




63 


'X 52 


38 




-17 


-25 


36 


U 


41 


27 




PCTGIRLS 






13 






28 


21 




17 




lo 






25 


40 


.-.3 75 


66 


33 




-24 


30 


24 


65 


32 




RESIDE 


26 


5P 






24 


-41 


-28 


33 










PCTWHITE 


27 


-40 


50 


58 


-22 


30 




-53 


21 


59 


18 


-27 


LIlsHARY 










30 










15 


U 




COUNSEL 


Z'j 




17 


22 


22 


20 


22 


-20 


25 


18 


19 


20 


STABLE 


30 


-15 






-14 




19 


t41 








35 


PAJUTT 


11 


38 


28 46 


36 


61 


26 


U 




36 




42 


P3 


MOiJESB 


.'2 


3C 


-17 




31 






2B 




-2i 




2'' 


MORESG 


J3 


30 


-29 


-39 


28 




27 


23 




-31 


19 


39 


VALUES 


34 


44 


18 




41 




19 


31 


23 




29 


38 


fiOMBCLIM 


35 


6'j 


31 




36 


28 


32 




34 




32 


4t> 



NOTE: All ^-'Trelfitlon coefficienta havR been rcunaed lo two 
vjtici.ml pc.iints have been omitted ♦ Only 'r|^ 0*U are 

O.U la fli^nlfiraiit at the .05 level 
^r\ ;^ 0.19 tii^jiliicarit at the .01 Wei 
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STUDENT DISTRIBUTIONS FOR COGNITIVE MEASURES 

A school mean alone disguises much about student performance on a given goal. Did 
all llie students score close to the school mean or were the student scores widely divergent? 
Indeed, very different student distributions could result in similar mean scores. 

Page 8 of the school report contains a distribution of student scores on the three cognitive 
measures included in the student questionnaires. 

The student scores from the normative sample were rank-ordered high to low and divided 
into five categories as nearly equal as possible. They represent tlie scores obtained by the top 
20 per cent of the students in the state, the next 20 per cent, down to the lowest-scoring 20 
per cent of students. In many cases no matter which of two cut-off scores was used, slightly 
more-or less-than 20 per cent of the students scored above that point. Therefore, the STATH 
NORM column may contain 19, 21 or 22 per cent. 

The SCHOOL ACTUAL column showr the percentage of students in the school who 
obtained scores in that range. 
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CRITERION-REFERENCED SCORING MODEL 



Included in each school report is normative information which indicates how a school 
scored in a given goal area relative to other schools in the state. This scoring method is com'mon 
in testing whea* people, for instance, are compared to the average pcrson-or the norm. 10 scores 
are an example of such a scoring procedure by which the average person is assigned a score 
of 100 and clhers receive scores then relative to the average. 

Difficulties in NormKitive Scoring Procedures 

Most people i;now about grading on the rwfw-another example of normative scoring. 
Perhaps two somewhat extreme examples will serve to show some real or hypothetical weaknesses 
in normative scoring. 



History 
test 



Math 
test 



30 



lOO'^ 



60 


> 




90 


60 




B 


90 


50 






80 


50 






80 


50 






80 


50 




C 


80 


40 






70 


40 




D 


70 



60 



Consider the above two sets of numbers as the scores of a class of 10 students on 
two tesis-a history lest and a math test. Assume further that the same girl received an A on 
each test. She earned her A in history by answering only 70 per cent of the questions correctly, 
while her A in mathematics required her to answer all Uie questions correctly. Are these As 
equal? Normatively, yes. But the normative scores (A in this case) say nothing of her mastery 
of history versus that of mathematics. 



A similar situation exists with the various EQA goal instruments. Should one be content 
with, say, i 90th percentile score? How far from perfect is such a score*^ The following table 
of statewide scores illustrates how percentile scores, as normative information, cloud some 
information: 

Goal Y Goal Z 
perfect score 



. 99%ile 

. 50%ile ' ^^^^il^ 

. 1 %ile 



SOC^rile 
l%ile 



zero score 
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In Goa] Y iho nui^ic t^f schnol scores In noi very jiaMi, sc) snnill cIvaiiKos in a sclux^rH 
raw scviie would diunuiivuUy chaiijic Ms jvrccnule rank. 

Secondly, u school at the Isi percentile on (li)aJ V is not all Thai lar IVoni pcrlectit^n. 
On a rclatrve scale, yes. (joal Y is a problem lor the 1st pewniile school. But. im an ahsoluic 
IxiMs, one ctvuld consider a 1st percentile score on (lOaJ Y* less ol a prohieni tluvn a 50th peiveniilcL 
score on (loal Z. In tact. GouJ Z\s Ivinji at tlic 99th }>crceniilc i^i not all tlvai much lo rave 
about on an absolute txijiis. In a vei*y crass way. one might consider sucli a score to the 
best tyf a hud 

The Move to Criicrion-Refercnced Scoring 

l:ducators-by their training, constant reinlorcemeni, and possibly the demaruls or 
expectations ol' the puhhc-tcnd to think normaiively. There is nothing wrong with that. But 
many argue that true improvement in student performance woxjJd he enhanced if one were t(^ 
nse some criterion, or better stiJl, some absolute, a?* one s goal rather than some average score. 

In the past few yeai^ examples of jusi such weaknesses in normative-based scores have 
occurred. At least one major tesimg firm found test scores on arithmetic computation dropping 
in recent years; this translates to telling more and more educators each year that more of their 
students are killing below the median. Such news does not endear one to the educators. Nor 
docs it sell many tests. The a^medy? Rcnorm the test in what amounts to lowering the standard. 

Such slippage in norms for achievement te^is is just that nvucli m^re dramatic when 
one considers norms for phenomena as unstable and ever<iianging as attitudes. The U)f)0 norms 
developed for grade 11 in Pennsylvania schools proved to t>e out of date by 1972, although 
the original plan was ii> use the nonns for five years. Dramatic drops m school scores cucurred 
in three areas; interest in school citizenship and appreciation of human accomplishments, 

A combination of these difficulties inspired a re-evaluation ol* providing only normative 
information in the assesNmeni reports. In the spring of 1073, in middle school and juni(>r Ingh 
schovil reports, a section based on a modified criterion-referencerl approach was adiled. This 
approach lias been adopted tor all grade levels in the attitudinal areas. 



Tlie Pennsylvinia Model of Critcrion>Rcferenced Scoring for Attitudinal Measures 



Consider ;m ilcm from ihc Goal J, SclMisteem instrument: 

/*m pretty mre of myxelf. 

3 A Very true of me 
2 B Mostly true of me 
1 C Mostly untrue of me 



+ 



0 D Very iminie of me 



Nonnative 
scoring 



Criterion 
scoring 



In the normative scoring method the degree of favorableness of a student s reply resulls 
in a score of 3. 2, 1 or 0. For the same item in the criterion'referenced scoring procedure, a 
dichoiomized approach is used; the students response is considered either favorable (very true 
of me. mostly true of me) or unfavorable (mostly untrue of me, very untrue of me). A criterion 
of 51 percent was established for the entire self esteem instrument of 40 items; that is, if a 
student answers a majority of the items (21 more) favorably, that student is said to have 
a minimum fmsitive attitude for Goal I. The number of such students is then tallied for the 
school and expressed as a per cent of all the students completing the inventory. So, one might 
discover that 65 per cent of the school's 5th grade students ha" : a minimum positive attitude. 
The other side of that coin, the negative side, is: 35 per cent of the students don't answer 
even a m^ority of the items favorably. One miglu. accepting the 51 per cent criterion, conclude 
that 35 per cent of The students could use some help, that their self-esteem is lagjpng. 

The criterion referenced information is given not only for each attitudinal goal but for 
MS various subscales aj. well. It is a modified criterion-referenced approach in that a school is 
given not only the per cent of its students satisfying the criterion, but also the per cent of 
students statewide answering a mjyority of the items favorably. This forces one back to a normative 
type of referena*. But i^ appears necessary, as many recipients of assessment, when told that 
65 per cent of their stuJents have a minimum positive attitude in self-esteem, ask: So what? 
What does that mean? Haw does that compare with. . Thus a comparison to the state is 
included. 



How Criterion-Referenced Information is Reported 

In tiie school report the per cent of students statewide with this minimum positive 
attitude on each attitudinal subscale is graphically represented by a row of S's, the per cent 
for the local school by a row of L's. 

This information should also give more specific diagnosis of strengths or weaknesses 
within a goal area by analyzing local scores vis-n-vis statewide scores. 

Furthermore, page 20 of the school report displays the same two rows, state and local, 
for the total scale-not just the subscales. 



« 
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Page 21 of the report* under the 51 per cent criterion cohimn, gives the exact numerical 
vakics which are "graphically displayed on pages 10-20. Two additional criterion levels are also 
provided if one desires a more stringent (70 per cent) or less rigorous (35 i^r cent) criterion. 
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SAMPLE SCHOOL REPORT 



The color pages which foUow duplicate an authentic school report, and data represent 
an actual Pennsylvania «chool. The report contains four items of information about the school: 

1.. Percentil<^ rank in state for each goal area. 

2. A predicted score range for each goal area. 

3. Condition variable scores, percentile rank and item breakdowns for selected 
variables. 

4A. For cognitive measures the distribution of student scores. 

^ 4B. For attitudinal measures criterion-referenced scoring information. 

Items 1 and 2 are found on page 2 of the report. Page 3 graphicaUy represents the 
mformation on page 2. 

Data for item 3 are found on ga^es 4 through 7. 
Data for item 4 A arc found-'on^age 8. 

^ describes, in general, the procedures used in the critc non-referenced scoring model 
(Item 4B). Blank pages are inserted at appropriate places in grade 1 1 reports where the measure 
IS cognitive and, hence, no criterion-referenced scoring is employed. The page is left blank to 
retain paraUeUsm across grade levels so that subsequent page numbcis are identical for the goal 
in question. 
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APPENDIX A 

TEACHER QUESTIONNAIRE 



School N«me_ District N«me^ 



INSTRUCTIONS: The informition recti^ed will N tBflregit^d and reported as relitionships to student achievemunt. No 
individuals will be identified and no individual information will be reported. Respond to the items by blackertmq the 
appropriate space. 

EXAMPLE: Are you a classroom teacher? Yes # No Q USE A NO. 2 PENCIL ONLY. 

UOCAlf 

Where hove you spent most of your lift? 

In Of within 30 miles of the boundaries of this school district O 

More than 30 miles but less than 100 miles from the present tx)undaries of this school district . O 

More than 100 miles froni the boundaries ot this schooi district. O 

In your teaching situation how satisfied are you with ^^ty satisfied - 

your relationship with: Somewhat satisf ied n 

Somewhat dissatisfied n 

ISATPAR ^^^^ dissatisfied n | 

Parents and parent groups. , . .©©O© 

Fellow staff members. ............ T?ATFS^ . .... .® ©O© 

Studoim TSATST^ .©©O© 

Almost always true 

Mark the answers which Ix st describe your Usually true ^ 

feelings about the comments below: Sometimes true n 

#l: TaATr #2-7:P£RSAD #8-10: PERQAD ^. Seldom true -. 

Almost never true^ | 

J^i^nioy classroom teaching ©©OO© 

Iht? adminiyiration in this school acts decisively on suggestions from the faculty .®©0©Q 

*. adminuitration in this school supports the disciplinary measures of the teachers .©©OOO 

The administration in this school encourages classroom innovation with real, practical support ©©O©© 

Tiu? administraiion in this school is concerned with real student progress as opposed to token programs 

which only appear to be progressive , .©©O©© 

The administration in this school is mora concerned with real student progress than with quiet, orderly 

classrooms ©©©©© 

The administration in this school encourages teacher initiative in regard to new programs, as opposed to 
^ handing down decisions which the teachers then must carry out. .........*..........,......,©©©©© 

[The central administration of this district treats teachers as professional, contributing members of the staff . . .©©©©© 
Teachers can expect support for their classroom policies from the central administration of this district. . . .©©©O© 
The central administration of this district is effective in developing realistic program goals ©©©©O 

CIPRACT I it daily -i 

Here is a list of some classroom practical. For each practica ^ . . . 

^ r . I use It weekly -i 

mark the column which bait indicates your use of tha practice. . « « ^ 

~— ' I use It monthly n | 

i do not use it n I I 

Pupil participation in lesson planning ©©©(§) 

Pupil participation in classroom teaching ©©©© 

Having pupils work in sntall learning teams ® ©©© 

Role playing (acting out situations) .©©©© 

Use of games to aid learning ©©©© 

Pupil evaluation of classroom climate ..©©©© 

Pupil participation in developing classroom rules .©©©© 

Involving pupils in community projects ©©©© 

Utilizing local citizens as resource personnel ©0©(O> 

Pupils as helpers or tutors of other pupils .0©OO 

Joint lesson planning with one or more teachers , ©©O© 

mc 1 1 1 1 1 



^ PIHIIRAT TPtRPAR 



Surv«y$ of ichciol proMimt show ■ numbar of ttiings rtporttd by tttchtri ai rtducinfl lha atfactivaoan of 
iha schooK Baiow ii a partial list of lhaia probiams. Mark Y (yai) for tfiota lituaiiom that conitituta a 
proWtm in your ichooi. Mark N (no) for ihon that do not comtituta a problam in your tchool. 

-Them n too much teacher tiitnOver , 

-The classes are loo lar^e tor effective teaching , . . 

♦There are toci many absencei among students 

^Pupils are not well fed and/or well clothed 

^The dif ferent races or ethnic groups don't get along together . » » 

*-Thcre are too many interruptions during class periods. 

^Teachers have too little freedom in such matters as textbook selection and curriculum* 
♦Parents attempt to interfere with the school ^ ....... v . 

%- There n too much competition for grades 

There rs too much emphasis on athletics , , 

There should be a bettci mixture; the students are all too much of one tVP« 
Too much time has to be spent on discipline 



Non 
Vai-, I 

...... . © 

...... . © 

...... ^) €) 

(2><S) 

...... 

. ! . . © €) 

.. 

...... .0® 

.0<S) 

©€) 

®e 

...... 

*The parents put too much pressure on tl>e students tor good grades , .0 <S) 

^The students aren't really interested in learning ..... .00 

-There ts a lack of effective leadership from the school administration , 00 

^The parents don't take enough interest in their children's schoolwork » .00 

-The teachers don't seem to be able to work well together .00 

-We have poor instructional equipment: supplies, books, laboratory equipment, ate 



TPEP 



Please mark the respense wtiich best deicrtbat 

how you usually faei> 



Almost always true of me n 
Often true of me -i 
Somatimas true of me ^ 
Seldom true of ma n I 
Almost navar true of me «^ | | 
1 feel that my id^as are considered worthwhile by my supervisors. ............................ .®®©©0 

1 have a lot of influence with my colleagues on educational matters ...,>.. .®®©@0 

i have cdnfidenc;e in myself even when people disagree with me ... * . .0® ©0© 

1 fmd it difficult to interact with others , 0®©®© 

I seem to be the kmd of person who has more bad luck than good luck . . . , .0®©® © 

I have trouble making up my mind about important decisions .©©0® © 

In my activities at school I am assertive and self-reliant 0®©®© 

1 don*t take a position on somethir^g until I tind out what my colleagues think , , . .© ® ©@© 




TEDUC 

Whlcii of tha following bast dascribas your laval of formal aducation? 

No degree • ...o 

Bachelor's degree O 

Master's degree or equivalency o 

Master's degree plus one year. . O 

Doctor's degree o 
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What ii your aviragt 9lai» 

sizs? (Exciuda iup«rvitorv 
duties such ai itudy hall.) 



STAffP 



®® 

©0 
®® 
(3) (3) 

®® 
®® 
®® 

®® 
®® 
®® 

I I 



I 



How many hours (to the 
nearest hour) are you 
assigned to classroom 
instruction par weak? 

HRPERWK 



®® 

00 
®© 
0® 
0® 
® 
® 
0 
0 
® 

I I 



Including this year, how 
many years of teaching 
experience do you have? 
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®® 

00 
®® 

00 
0® 
0® 

® 
0 
0 
0 

I I 



FOR SECONDARY ONLY 
Hovf many different courses, 
on 'Jx ivaragi, do you 
teach per day? 

PREPtRDY 



® 
0 
® 
0 
0 
0 

® 

0 
0 
0 



I I I I I I 



